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We normalize the combinatorial Laplacian of a graph by the degree sum, look at its eigenvalues as 
a probability distribution and then study its Shannon entropy. Equivalently, we represent a graph 
with a quantum mechanical state and study its von Neumann entropy. At the graph-theoretic level, 
this quantity may be interpreted as a measure of regularity; it tends to be larger in relation to the 
number of connected components, long paths and nontrivial symmetries. When the set of vertices 
is asymptotically large, we prove that regular graphs and the complete graph have equal entropy, 
and specifically it turns out to be maximum. On the other hand, when the number of edges is fixed, 
graphs with large cliques appear to minimize the entropy. 
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I. INTRODUCTION 



The quantum entropy (or, equivalently, von Neumann 
entropy) was defined by von Neumann around 1927 for 
provin g th e irreversibility of quantum measurement pro- 
cesses [2q. Precisely, tlie quantum entropy is an exten- 
sion of the Gibbs entropy to the quantum realm and it 
may be viewed as the average information the exper- 
imenter obtains in the repeated observations of many 
copies of an identically prepared mixed state. It has a 
fundamental role for studying correlated systems and for 
defining entanglement measures [29l . Isoj . In the present 
work we elaborate on the notion of quantum entropy ap- 
plied to networks. Since the quantum entropy is defined 
for quantum states, the first required ingredient is there- 
fore a method to map graphs/networks into states (while 
the converse is not necessary in our purpose). The liter- 
ature comprises different ways to associate graphs to cer- 
tain states or dynamics. Notably, graph-states and spin 
networks, just to mention two major ones: graph-states 
are certain quantum error correcting codes, important for 
characterizing the computational resources in measure- 
ment based quantum computation [l9j ; spin networks 
are arrangements of interacting quantum mechanical par- 
ticles, nowadays of great significance for the development 
of nanotechnologies [1, 0, [2l| . We take a straightforward 
approach, and take into analysis an entropic quantity for 
graphs on the basis of a faithful mapping between dis- 
crete Laplacians and quantum states, firstly introduced 
by Braunstein et al. ^ (see also [13 )■ In synthesis, we 
see the spectrum of an appropriately normalized Lapla- 
cian as a distribution and we compute its Shannon en- 
tropy ^8.] (which measures the amount of uncertainty of 
a random variable, or the amount of information ob- 
tained when its value is revealed). Such a quantity finds 
a natural place among those global spectral parameters of 
graphs (i.e., involving the entire spectrum and not just a 
specific eigenvalue) studied in connection to natural and 



social networks. For example, the Estrada index, a mea- 
sure of centrality [31 , also used to quan tify the degree of 
folding of long-chain molecules [T^. Il3l [24|: or the graph 
energy, that in Hiickel theory corresponds to the sum of 
the energies of all the electrons in a molecule [l3, fisj . 
(See the book chapter for a general review on com- 
plexity measures for graphs.) We give evidence that the 
quantum entropy is a measure of regularity for graphs, 
i.e., regular graphs have in general higher entropy when 
the number of edges is fixed. Moreover, entropy seems 
to depend on the number of connected components, long 
paths, and nontrivial symmetries. Chosen the number 
of edges, entropy is smaller for graphs with large cliques 
and short paths, i.e., graphs in which the vertices form 
an highly connected cluster. The remainder of the pa- 
per is organized as follows. In Section [ll] we introduce 
the required definitions and focus on some basic proper- 
ties. By adding edges one by one to the empty graph, we 
try to construct graphs with minimum and maximum en- 
tropy. In Section lTTTl we explore the infiuence of the graph 
structure on the entropy. We consider different classes 
of graphs: regular graphs, random graphs, and the star 
as an extremal case of scale-free graph [i.e., graphs for 
which the degree distribution follows a power law). The 
asymptotic behavior for large number of vertices shows 
that regular graphs tend to have maximum entropy. We 
study numerically how the entropy increases when adding 
edges with different prescriptions. Once fixed the number 
of edges, the entropy is minimized by graphs with large 
cliques. Section [TVl contains remarks and open problems. 



II. FIRST PROPERTIES 

The state of a quantum mechanical system with a 
Hilbert space of finite dimension n is described by a den- 
sity matrix. Each density matrix p is a positive semidef- 
inite matrix with Tr(/9) = 1. As we have already men- 
tioned in the introduction, there are many ways to as- 
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sociate graphs to specific density matrices or Hamilto- 
nian evolution {e.g., graph states, bosonic systems, etc.). 
Here we consider a matrix representation based on the 
combinatorial Laplacian. Let G = {V, E) be a simple 
undirected graph with set of vertices V{G) = {1, 2, n} 
and set of edges E{(J) C V{G) x V{G) - {{v,v} : 

V G V{G)}. The adjacency matrix of G is denoted by 
A{G) and defined by [A{G)]u,v = 1 if {w, v} G E{G) 
and [^(G')]„.t, = 0, otherwise. The degree of a vertex 

V S V{G), denoted by d{v), is the number of edges ad- 
jacent to V. A graph G is d-regular if d{v) = d for all 

V 6 V{G). Let do be the degree-sum of the graph, 
i.e. do = S«ey(G) '^('^)- "^^"^ average degree of G is 
defined by da '■= X]«ey(G) '^(^)' where n is the num- 
ber of non-isolated vertices, that is vertices v such that 
{u,v} G ^'(G) for some u G 1^(G). The degree matrix 
of G is an n X n matrix, denoted by A(G), having wii-th 
entry defined as follows: [A(G)]„ ^ = if w = w and 
[A(G)]jj^ = 0, otherwise. The combinatorial Laplacian 
matrix of a graph G (for short, Laplacian) is the ma- 
trix L(G) = A(G) - A[G). The matrix L{G) is a major 
tool for enumerating spanning trees (via the Matrix- Tree 
Theorem) and has numerous applications (see Kirchhoff 
[13], Biggs [I, and Grone et al. [H, [l3])- As a con- 
sequence of the Gersgorin disc theorem, L{G) is posi- 
tive semidefinite. By these definitions, the Laplacian of 
a graph G scaled by the degree-sum of G is a density 



matrix: pc 



PG 



L{G) 



L{G) 
do 



L{G) 
Tr(A(G))- 



It is then clear that 



The entropy of a density matrix p is defined 
as S{p) = — Tr(/3log2 p). Now, given the notion of Lapla- 
cian, we say that S{pg) is the quantum entropy (or, for 
short, entropy) of G. Let i^i > > • • • > i^n = and 



Al > A2 > 



> 



A„ = be the eigenvalues of L{G) 



and pg, respectively. These are related by a scaling fac- 
tor, i.e. \ = = * ~ The entropy 
of pg can be also written as S{G) — — X^^-i K log2 A^, 
where log2 = 0, by convention. (See ^27,] for a sur- 
vey on Laplacian spectra.) Since its rows sum up to 0, 
then is the smallest eigenvalue of pc- The number of 
connected components of G is equal to the multiplicity 
of as an eigenvalue. The largest Laplacian eigenvalue 
is bounded by the number of non-isolated vertices, i.e., 
vi < fi (see Duval et al. Proposition 6.2); thus it 
follows immediately that < Aj < for i = l,...,n. 

It is important to remark that since < A, < ^ < 1, 
for i = 1, n, S{pg) equals the Shannon entropy of the 
probability distribution {Xi}f^i. If a general density ma- 
trix p has an eigenvalue 1 then the other must be and 
p = p^. In such a case, the density matrix is said to be 
pure; otherwise, mixed. For later convenience, we define 
the quantity i?(G) :— ;^ X]"=i log2 The disjoint 
union of graphs G and H is the graph G' = G ^ H, 
whose connected components are G and H. We denote 
by Kn the complete graph on n vertices. Let Qn be the 
set of all graphs on n vertices. The next fact was proved 
by Braunstein et al. [5,]: 



Theorem 1 Let G be a graph on n > 2 vertices. Then 
ming„ S{G) — if and only if G = K2 1+)^ k\''^ and 
maxg^ S{G) — log2(n — 1) if and only if G = Kn. When 
n ^ 2, then ming^ S{G) — maxg^ S{G) = and G = K2. 

For general density matrices, S{p) = 0, if p is a pure 
state; S{p) = - log2 ^ = log2 " if p = i.e., a com- 
pletely random state. The analogue in is if„ given 

that the spectrum or pK„ is {;;3y^" ^',0^^'}. The next 
result bounds the variation of the entropy under edge ad- 
dition. Let G' = G -I- {x,y}, where V{G) = V{G') and 
E{G') = E{G) U {u,v}. An alternative proof could be 
given by invoking eigenvalues interlacing lol ]. 

Theorem 2 For graphs G and G' = G + {x, y}, we have 
S{PG') > ^S{pg). 

Proof. Chosen a labeling of V{G), for G G Qn we can 
write A{G) = J2{u,v}eE{G) "^i"^^"")' where A{u,v) is the 
adjacency matrix of a graph G{u,v) := {w, v} 1+J"=i^ ^1. 
We can then define an 71 x n diagonal matrix A(m, v) such 
that JA(u, ?;)]„,„ = [ls.{u,v)]v,v = 1 and [A(m, u)]„,^ = 
iiu ^ V. It follows that A(G) = X]{«,i,}gb(G) ^("' 

Then PG = ^E{«,i,}G£;(G)(^("'«) - ^("'«))- Let 
{]!), ]2), ]n)} be the standard basis of C". By def- 
inition, \i) = (0i,02...,0i_i, li,Oi+i, ...,0„)^. We asso- 
ciate the pure state ]{u,w}) = "^(1^) ~ b)) to the edge 
{u, v}. Let P{u, v) be the projector associated to \ {u, v}): 
P{u,v) = i(/2-o-^). Then PG = ^ E{„,^}e£;(G) ^("' 
and pg' — j^Pg + 'j^Pi^TV)- It is well-known that 
the entropy S is concave (see Ohya and Petz 30]): 
S {^\^iCtiPi^ > J2i=i<^'.S{pi), where pi are density 
matrices and ai G M^. Hence S{pG') > ■^S{pg) + 
-^S({x,y}). However, since S({x,y}) = 0, the claim is 
true. ■ 

Starting from 1^2 1+1^- ^P'' (the graph with zero en- 
tropy) we can think of a discrete-time process in which 
we add edges so that the entropy is extremal (resp. maxi- 
mum or minimum) at every step. Let us denote by Gf^^^ 
and Gf™, i > 1, the graphs with maximum and min- 
imum entropy at the i-th step, respectively. Figure [T] 
contains S{Gf'''') and S{Gf") (resp. sohd and dashed 
line) as functions of the number of edges i = 1, 2, 15, 
for graphs in 06 • The initial graph is G'j"^'^ = Gf" = 
K2 1+1^^3 k[^^; the final one is Gfg'^'^ = Gfg'" = Kq. Each 
edge labeled by j < i in the graph Kq on the left (resp. 
right) hand side of Figure[2]is also an edge of Gf^'^^ (resp. 
G™'"). This illustrates the steps for constructing every 
Gf"""" and Gf''". It turns out that the vertices of Gf^^'^ 
tend to have "almost equal" or equal degree. In fact Gf '^'^ 
is a z/3-regular graph, for i — 3,6,9,12. On the other 

hand, GJ^/!^i)/2 = Wj^l if Z = 3, 4, 5. The mean- 

ing is without ambiguity: entropy is minimized by those 
graphs with locally added edges, i.e. edges increasing 
the number of complete subgraphs (also called cliques). 



3 



Even if we consider graphs with only six vertices, it is al- 
ready evident that long paths, nontrivial symmetries and 
connected components give rise to a larger increase of the 
entropy. This property is confirmed by further numerical 
analysis in the next section. 
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FIG. 1: Plots of 5'(Gr="') andS(G™) (resp. solid and dashed 
line) as functions of the number of edges i = 1,2,..., 15. 




S{G) = -i Eti 1^ lofe i| + i Er=i 1^ log, n. Given 
that Tr(pG) = = 1> by taking R{G) := 

^Er=i i^log2 -j^, the quantum entropy of G is given 
by S{G) = -R{G) + log2 n. Since S{Kn) = log2(n - 1), 
we have S{G) = -R{G) + ^iog^"(i°^i)" ■ From this ex- 
pression, we see immediately that if lim„^oo — 

then lim„^oo siK^^) ~ -Now, let us consider G G Gn.d- 
Since d{v) = d for every v € V{G), it follows that d ^ d 
and i^i = d — fii. Given that for a d-regular graph — d < 
fii < d, we have < ^'^ < 2d, for every i — 1, ...,n. The 
quantity R{G) is now given by R{G) = ^ J2'i=i log2 ^^i, 
where xi = and < < 2. The function log2 
assumes finite values in the range [0,2]. Thus R{G) is 
also finite. In particular, since R(G) is an average, it re- 
mains finite even if considering an arbitrary large number 
of vertices. This implies that the entropy for a d-regular 
graph tends to the entropy of in the limit n — > co. ■ 
It may useful to remark two points: (1) The sim- 
plest regular graph is the perfect matching Mn 
^]j=i ■ The density matrix of M„ is then pM„ = 

i ®n/2 ti.„es ^^^d ^(^^") = -t (I I) = 

log2 f , because A^*' = f and A^^' = 0. Thus, S{Mn) = 
S{K^/2+i). For Mi we have S{Mi) ^ S{Kj,) = 1. More 
generally, S {M2k) = k-l. (2) The entropy of G G Qn^oo 
tends to the entropy of Kn if all the quantities ^ remain 

finite, i.e., lim„^oo = 0. 

The complete bipartite graph Kp^q has V{Kp^q) = AU 
B, where \A\ = p and \B\ — q, and each vertex in A is 
adjacent to every vertex in B. The graph Ki_n-i on n 
vertices is said to be a star. 



FIG. 2: This figure shows two complete graphs with la- 
beled edges. For the graph on the left hand side, the edge 
labeled by i is added at time i in order to construct G™''". 
The graph on the right hand side is the analogue drawing for 

^min 



Theorem 4 Let G G 5„ with v such that {v,u} G 
E{G) for every u, and let lim„_,oo = d^o < oo. 

< 1 — -J—. In particular, the 



Then hm„^oo 

star Ki n-i saturates the bound, since doc — 2, and 

1 

2 • 



lini„^oo S{Ki^n_i)/S{K„) 



III. ENTROPY AND GRAPH STRUCTURE 



Let Qn,d be the set of all d-regular graphs. For G G 
Gn^d, we have A(G) = d/„, and hence A^ = TrtA(G)) ^ 
, for i = 1,2, ...,rt, where /i^ denotes the i-th eigen- 
value of A{G). 

Theorem 3 Let G be a graph on n nonisolated vertice. 
//lini„^oo = then lim„^oo = 1. In partic- 

ular, if G e Gn,d then lim„_,oo = 1- 

Proof. When G G Gn, PG = where 
da = ^E^ey(G) ^(")- Since Ai = we have 



Proof. Let G be as in the statement. So, di ~ 
71 — 1. For a graph with at least one edge, Gronc et 
al. (see [13], Corollary 2) proved that vi > di + \\ 
for a generic graph on fi — n vertices, we know that 
vi < n (see Duval et al. 11], Proposition 6.2). By 
these two results, vi = n. Thus, we have R(G) = 

1 Vi ■] Vi 1 ] nil Vi i Vi 

n 2^t=l iOg2 d^ - d^ iOg2 + « 2^i=2 d^ iOg2 

and hm„^oo -^^^ > j^- Because S{G) = -i?(G) + 
log2 n, we have lim„^oo (f/^\ < 1 ~ zz:- Now, the eigen- 



values of PKiri-i are A^ 



[1] 



Ai 



1-2] 



and 



2n-2 ' ^^2 

A3^' = 0. Thus, the entropy is given by S'(A'i_„_i) — 

~2;r=2 log2 2;f=2 + 5^1og2(2n - 2) and in the limit 
n — > cxD we have the second part of the statement. Since 
d — 221^ it results c?^ = 2 and the bound is saturated. 
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Similarly to what we have done in the previous section, 
we observe how the entropy of a graph G € Gn increases 
as a function of \E{G)\ — e. Starting from K2 l±Jj=f 
we consider four different ways of adding edges: (i) Ran- 
dom graphs with exactly e edges. These are constructed 
by chosing e pairs of vertices at random from the to- 
tal number of pairs; (ii) The graph l+J^T^^^ i^P"* ; 



(Hi) The graph Ki ^ 



K, 



e+l) 

where 



-1^0). 



2 



(iv) The graph 
Recall that 



adding isolated vertices to a graph does not change its 
entropy. Figure [3] shows the case n = 20. It is evi- 
dent that the entropy is larger for graphs with an high 
number of connected components. In this sense, M„ has 
relatively high entropy. The smallest entropy is obtained 
for complete graphs. 






Perfect Matching 




Random 




Stm- 




Complete 



FIG. 3: Plots of the entropy of four different kind of graphs 
as a function of the number of edges e = 1, 2, . . . , 190. The 
different plots represent different ways of adding edges to a 
graph with n — 20 vertices. The value of S{Rn,e) have been 
avaraged over 15 different random graphs, for each value of e. 



IV. CONCLUSIONS 

Next is a list of remarks and open problems: 
Normalized Laplacian. We have considered the com- 
binatorial laplacian L{G). There is a related matrix 
called normalized Laplacian and defined by C{G) = 
A-i/2L(G)A-i/2 (by convention [A-i]^,,„ = if d{v) = 
0). It results that [C{G)]u.v — I it u — v and d{v) ^ 
0, [C{G)]u,v = -l/y/diu)d{v) iiVu,v} G E{G), and 
[C{G)]u,v — 0, otherwise (see 0, [s^]). If a graph has 
no isolated vertex then Tt(C{G)) — n. Therefore, we can 
define the density matrix pa '■— The entropy of pc 

is then 5(pg) = -Tr(^ log^ ^) ^ -W + logs n = 
— iTr(£(G) log2 ^(G)) + log2 n. Since the eigenvalues of 
C{G) are in [0,2] [9|, when limit n — > 00, the quantity 
W remains finite. We may then conclude that when the 
number of vertices goes to infinity, the entropy S{pg) 



tends to S{pK„)- This fact provides a motivation for 
dealing with L{G) instead of C{G). 

Algebraic connectivity. Let a{G) = Vn-i be the alge- 
braic connectivity of G [31 . It is nonzero only if G 
is connected. The value of a(G) quantifies the con- 
nectivity of G. Is there a relation between a{G) and 
S{pg)^ Consider Kn and the n-cycle C„, that is the 
connected 2-regular graph on n vertices. For these, 
a{K„) = n and a(G„) = 2(1 - cos^ZL). By TheoremU 
lim„^oo S(Cn) = S(Kn). However the algebraic connec- 
tivity of the two graphs behave differently in this limit: 
lim„^oo a(-ft^n) = 00 and hm„_oo a(C„) = 0. 
Eigenvalue gap. Let b{G) — pi — fJ-2 be the eigenvalue 
gap of G. This parameter determines the mixing time 
of a simple random walk on G (see Lovasz (l^). If G G 
Gn,d then a(G) = &(G). Hence lim„_+oo b{Kn) = 00 and 
lim„_+oo b{Gn) = 0. We can therefore state that b{G) and 
S{pg) describe different properties of G at least on the 
basis of this basic observation. 

A combinatorial definition. It is unclear whether S{G) 
is related to combinatorially defined entropic quantities. 
For example, the Korner entropy defined in [23| (see also 
Simonyi 32] for a survey) or the entropies defined by Riis 
[3I1] and Bianconi Intuitively, any relation should 
be weak, because the quantum entropy depends on the 
eigenvalues. For this reason it describes some global sta- 
tistical behaviour, with only partial control over combi- 
natorial properties. 

Beyond cospectrality. Graphs with the same eigenval- 
ues have equal entropy. We have seen that also perfect 
matchings and complete graphs plus a specific number of 
isolated vertices have equal entropy, but are clearly non- 
cospectral (see Section llll| . Determine families of graphs 
with the same entropy remains an open problem. 
Relative entropy. The quantum relative entropy is a mea- 
sure of distinguishability between two states (see the 
review fsj]). Given two graphs G and iJ, the quan- 
tum relative entropy may be defined as S{G\\H) := 
— Tr(pG log2 jOif) — S{pg)- What kind of relations be- 
tween the two graphs are emphasized by the relative en- 
tropy? To what extent can this be used as a measure of 
distinguishability for graphs? 

We conclude with two open problems: does the star 
Ki^n-i have smallest entropy among all connected graphs 
on n vertices? Is the entropy strictly monotonically in- 
creasing under edge addition? 
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